Phase Separation of a Fast Rotating Boson-Fermion Mixture 
in the Lowest-Landau-Level Regime 
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By minimizing the coupled mean- field energy functionals, we investigate the ground-state prop- 
erties of a rotating atomic boson- fermion mixture in a two-dimensional parabolic trap. At high an- 
gular frequencies in the mean-field-lowest-Landau-level regime, quantized vortices enter the bosonic 
condensate, and a finite number of degenerate fermions form the maximum-density-droplet state. 
As the boson-fermion coupling constant increases, the maximum density droplet develops into a 
lower-density state associated with the phase separation, revealing characteristics of a Landau-level 
structure. 
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Experimental developments in the cooling techniques 
of atomic gases have provided new opportunities to in- 
vestigate the quantum-degenerate regime where Bose- 
Einstein condensations (BECs), Fermi-Dirac (FD) degen- 
eracies 0, 1^, and BECs of paired states emerge 0. 
The heteronuclear Feshbach resonance, which was re- 
cently found in a boson-fermion mixture 0, also en- 
ables us to investigate the quantum-statistical origin 
of novel phenomena. This system sheds light not 
only on our understanding of boson-mediated pairing of 
fermions 6], but also on the relationship to condensed 
matter physics 7J, multicomponent systems 's^, and the 
study of the normal and superfluid states of fermions 9] . 

When a superfluid system is subjected to an external 
rotating drive above a critical angular frequency, the sys- 
tem forms quantized vortices, which are experiment ally 
observed both in bosonic 10] and paired fermionic 
systems. On the other hand, a number of analogies 
have been pointed out between neutral atoms subjected 
to an external rotation and charged particles in a mag- 
netic field 0, 0, regardless of quantum statistics of 
atoms. As an example, a finite number of electrons in a 
quantum dot (QD) (e.g., realized in a semiconductor het- 
erostructure) form the maximum density droplet (MDD) 
state 0, reflecting the lowest-Landau- level (LLL) struc- 
ture of electrons under a strong magnetic field. In the 
MDD, the total angular momentum of electrons takes the 
lowest possible value due to the FD degeneracy and the 
Pauli exclusion principle. However, the interplay between 
the Pauli pressure plus potential term and the electron- 
electron interaction causes an instabilit y a gainst density 
modulation or edge reconstruction |ld Il7| . Such recon- 
structions are expected to emerge in the spin-polarized 
fermions under fast rotation. 

In this Letter, we address the boson-fermion mixture. 



and show that reconstruction process is associated with a 
phase separation between components due to the signif- 
icance of repulsive boson-fermion interaction in the fast- 
rotating regime. For larger external angular frequency 
the components separate at smaller interaction, and the 
increase in the angular momentum of fermions from one 
of the MDD state is quantized at the integral multiple 
of the total number of fermions after phase separation. 
However, this quantization can be violated at the phase- 
coexistent regime as a consequence of the rotational sym- 
metry breaking of the BEC with a vortex lattice. 

We consider the gaseous atomic mixture of A^b bosons 
and spin-polarized Ap fermions in a parabolic trap which 
rotates around the z axis. When the angular frequencies 
of the trap are highly anisotropic as cj^ ^ oOx^y = cj, 
the atomic motion virtually reduces to two-dimensional 
(2D). The trapping frequencies and atomic masses for 
the two components are assumed to be identical, being 
denoted as co and M. Henceforth, the angular momenta, 
energies, and lengths are measured in units of fi, hco, 
I = ^Jhj [Mijj\ respectively. 

The low-energy scatterings are characterized by 5-wave 
scatterings which are modeled by contact interactions. 
The interaction and correlation between fermions are 
thus absent because of the Pauli principle. The dimen- 
sionless 2D boson-boson and boson-fermion couplings 
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^, h are related to the 3D ones 
and h^^^ = ^nh^aBF/M^ as g 

h = h^^^ /{^/^lilz) with Iz = ^Jh/ {MuOz)^ respectively. 
We treat the boson-boson interaction and boson-fermion 
interaction within the mean-field approximation, which 
is valid for a weakly-interacting system under moder- 
ate rotating drive. As the rotating drive increases, both 
components will enter the mean-field-lowest-Landau-level 
(MF-LLL) regime 18], where the single-particle states 
are described within the LLL, but the mean- field approx- 
imation is still valid Throughout this paper, we ad- 
dress the regime where the mean-field approximation is 
expected to be valid. 

Let us suppose that the bosons are BE-condensed oc- 
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cupying a single-particle state t/^b, while the fermions 
are FD-degenerate occupying single-particle orbitals 
mean-field energy functional in the ro- 
tating frame is given by 

Eb = NbJ cfr^^ir) + |nB(r)] V^bW, (1) 



Ebf 



Nf 

i=i 



E 4'^ ; 4'^ = / dV4^> (r)^^-'') (r), (2) 



h J dPrnY{r)nB{r)^ 



(3) 



where H = (— + r^)/2 — Q.Lz is the Hamiltonian for a 
free atom with = —i{xdy — ydx)^ and is the angular 
frequency of the external rotating drive in unit of uo. The 
densities are given by nB{r) = A/'b|'0b(^)P, and nF{r) = 



Sj^Ti l'0F^(^)P' where the summation over j is taken 
over all occupied states of fermions. The eigensolutions 
of ^ 



r(0) 



: n + m -h 1 — Q.{m — n), n^m = 0^ 1, (4) 
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are well-defined angular-momentum states, 
LzUnm{r) = {m- n)Unm{r). 



I.e., 



We expand the single-particle orbitals as '0b(^) = 



(r), and 



(r) = En 



^ fnrn'^nrnix)') and 



minimize the total energy with the normalization condi- 
tions En^m^lm = En^m fn^ = 1' ^hcrc bnm and fnm 

are taken to be real without loss of generality. We then 
numerically iterate minimization of eb = {Eb -\- Ebf) / Nb 
and diagonalization of = Sf -\- h fd^r2p^nB'ipF until 
they self-consistently converges j^O, I^. Since we use 
the mean-field approximation, we find a relevant break- 
ing of rotational symmetry in the density distributions 
without investigating higher-order correlation functions. 

The ground-state angular momentum of each compo- 
nent is shown in Fig.Qas a function of Q. The total angu- 
lar momentum of the BEC, Lb = A^b En m ^'nmi^ ~ 
remains zero associated with the superfiuidity. For 
fermions, in contrast, Lp = E^IiEn,m f^^m {'m - n) 
increases as Vt exceeds zero. Within the semiclassical 
description with the rigid-body rotation, the total an- 
gular momentum of free fermions is given by L^^^ = 
= (8ArF)3/2^/(24vT 



nJr^nF{r)£ 



1^2). This func- 



tion is plotted with the dashed curve in Fig. ^ and is 
found to agree well with Lp for slow rotating regime. 
The semiclassical theory of a free fermi gas is there- 
fore good 22] even when fermions weakly interact with 
bosons. 

As the angular frequency of the external rotating drive 
increases. Lb jumps from zero to A^b at 

n^^^ = 1 - G - 2bl, - 2Gbu [bii - (1 + bl,)boo] (6) 



where G = gNB/{87r), and bj^ = G^/{8G^ + 2G + 1), 
^00 = 1 ~ ^11 .23]. This jump corresponds to the onset 
of vortex formation in the BEC. The dominant contribu- 
tions to 17c?^ are the first two terms which coincide with 
the result within the LLL approximation. The remain- 
ing terms arise from the higher Landau levels which are 
almost negligible as compared with the first two terms, 
but modify l^c?^ as g increases. We find from the nu- 
merical and variational calculations that the BEC with 
qNb < 0(1) enters the MF-LLL regime in 1^ > l^^f^ 
where the quantized vortices successively form in the 
BEC. 

For fermions the semiclassical description fails in a 
fast-rotating regime because the energy-level discrete- 
ness becomes crucial. This is shown in Fig. ^(b), where 
the emergence of the plateau at L^^^^ and the signifi- 
cant deviation from L^^^ are the manifestations of the 
fact that fermions enter the LLL regime. The degener- 
ate fermions occupy from the lowest level m = up to 
the highest level m = Nf — 1 in the LLL according to 
the Pauli principle, and hence Lp is frozen at the value 
^(MDD) _ j^^i^js^^ _ i)/2 whereas L^^^^ diverges. The 
order of Q at which the fermions cross over from the 
semiclassical to a quantum regime is estimated by the 
condition L^^^ = L^^^^ , as 



3(A^F - 1) 

y'm^ + unf - 9' 



(7) 



which approaches unity in the limit Np oo. 

On the Lp^^^^ -plateau the fermionic density becomes 
maximum, which is thus called a MDD in QDs with a 
finite number of electrons 15]. The area occupied by 
fermions becomes minimum since the mean-radius of the 
LLL orbital is given by (r^)^ = ^ + 1- The MDD state 
is the trivial ground state of free fermions in the MF-LLL 
regime, and is regarded as the fermionic counterpart of 
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FIG. 1: (color online) Total angular momentum of each com- 
ponent with A^B = 1000, A^F = 25, and g = 0.5/i = 2 x 10~^. 
(a) Plateau at zero in Lb arises from the irrotationality. Small 
steps in Lf arise from the size effect. These steps become in- 
visible for larger Nf{^ 500). (b) Enlargement of (a) for the 
fast-rotating regime. 
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a BEC without a quantized vortex in terms of the angu- 
lar momentum • The corresponding many-body wave 
function of fermions is given by the Slater determinant 
constructed by the LLL orbitals ilj^\r) = 'Wom(^) foi" 
m = 0, 1, . . . A^F — 1, which is shown to be reduced to the 
Laughlin wave function of the integer quantum Hall state 
with = 1, 



where Z 



-'Nf 



Zj ) exp 



E 



i<j 



(8) 



zy. 



In the absence of the boson-fermion 



interaction, Lp remains L^^^^ for Q > In the 

presence of the boson-fermion interaction, however, Lp 
begins to increase in the limit ^1 ^ 1 as shown in Fig. Q 
(b). This behavior features a phase separation caused 
by the boson-fermion interaction, and is not the reminis- 
cent of the divergence in Lp of free fermions. In the 
same manner as the nonlinear interaction of the BEC 
leads to the successive formation of quantized vortices, 
the boson-fermion interaction also induces the successive 
penetration of fluxes of angular momenta in the fermionic 
cloud. 
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FIG. 2: (color online) (a) Density, and phase (inset) profiles 
of the bosonic condensate wave function, (b)-(e) Density pro- 
files (upper panels) and mean angular- momentum distribu- 
tions (lower panels) of the fermionic cloud for/i/^ = 0,l,1.5, 
and 2.5, respectively. 

In order to examine how the boson-fermion coupling 
modulates the ground state in the MF-LLL regime, we 
henceforth restrict the bases Unm within the LLL, omit- 
ting the index n. Typical density profiles for several val- 
ues of h are shown in Fig. [2 where other parameters 
are fixed to he Q = 0.995, TVb = 1000, TVf = 12, and 
g = 2 X 10~^. The number of quantized vortices re- 
mains unchanged, and hence the condensate wave func- 
tion looks like ones shown in Fig. [21 (a) throughout the in- 
crease in h. In contrast, the fermionic density np changes 
drastically as h increases. The histograms show the mean 
angular-momentum distribution of fermions defined by 
P{m) = E,=occ l/m^lV^F, which is equal to l/7Vp for 
< m < ATp - 1 in the MDD state [(b)]. When the 



weak interaction is introduced [(c)], the occupations of 
some low-angular-momentum states begin to be partially 
shifted to higher-angular-momentum states which are not 
occupied in the MDD state. The fermionic density in- 
creases in the vortex cores of the condensate, breaking 
the rotational symmetry in order to reduce the repul- 
sive interaction energy. The derivation from the homo- 
geneous distribution l/N-p in P{m) is a signal of the ro- 
tational symmetry breaking. As h increases further [(d)], 
more angular-momentum states are shifted, and the re- 
gion where components overlap gradually decreases. The 
bosonic and fermionic densities eventually separate for 
larger values of /i, where a large central hole emerges in 
the fermionic cloud [(e)]. The mean angular- momentum 
distribution again becomes uniform with the value l/N^ 
for M < m < M + — 1, and the rotational symme- 
try in np is recovered independent of the configuration 
of the vortex lattice in the BEC. This state is regarded 
as the penetration of M fluxes of angular momenta in 
the MDD state. Such a quasi- ID-like density and corre- 
sponding angular-momentum distribution also occur in 
the case of free fermions in > 1 with an elimination of 
the centrifugal singularity [ij, [2J . 

We next study the changes in the total angular mo- 
mentum of each component and the boson-fermion in- 
teraction energy associated with the phase separation in 
the MF-LLL regime. In Fig. [31 we show Lb = Lb/Nb^ 
Zp = (Lp — Lp^^^^)/A/'p, and Ebf for several val- 



ues of Q and A/'p, with a = 2 x 10 ^ and Nb 



10^ 




h/N^ [xlO ] 



FIG. 3: (color online) (a)-(c) Total angular momentum of 
each component for three values of Three plots of Lb in 
each panel denote the results with Nf = 32, 64, 128 from top 
down. The plateaus in Lp are located at zero or positive 
integers, (d) Boson- Fermion interaction energy Ebf- Jumps 
in Lb, Lf, and Lbf occur at the same values of H/Nf for a 
fixed Q. 
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h/Np. Before the phase separation, Lb and Lp are 
nearly constant and Ebf hnearly increases with h/N-p. 
At a critical value h/N-p where ^bf becomes maximum, 
the phase separation occurs and fermions begin to ro- 
tate around the BEC. Since the boson- fermion interac- 
tion becomes significant for larger the critical value 
of interaction h becomes smaller for a faster rotating 
drive. After the phase separation, the system is well 
described in terms of noninteracting fermion model, be- 
cause the fermions recover the rotational symmetry af- 
ter phase separation and the value P{m) cannot deviate 
from The angular- momentum states of fermions 

in the phase-separating regime are therefore regarded as 
states where some angular-momentum fluxes penetrate 
the MDD. Let us define M as the number of fluxes of 
angular momentum where the fermions homogeneously 
occupy the single-particle states ranging from m = M 
to m = M + Np — 1. The difference between the total 
angular momentum of fermions Lp^^ with M fluxes and 
one of the MDD state is given by 

l(M) _ j^iUDD) ^ j2 ni-Y.m = MN^. (9) 

m=M m=0 

The corresponding many-body wave function of fermions 
with the angular momentum Lp^^ is constructed by suc- 
cessive multiplications of the symmetric polynomial 

S{ZuZ2,...,Zn,) = 1[Zj (10) 
j 

to the MDD state given by Eq. 0, where the an- 
tisymmetry of the fermionic wave function is ensured by 
^p^ [2^. The polynomial S increases the angular mo- 
mentum of each fermion by one, and the change in the to- 
tal angular momentum Lp is thus given by Np. Upon the 
increase in M, the boson-fermion interaction energy Ebf 
decreases discontinuously as shown in Fig.|ni(d). The to- 
tal angular momentum of bosons is partially transferred 
to fermions only when the number of quantized vortices 
in the BEC is larger than unity, and the number of vor- 
tices remains unchanged. On the other hand, the radius 
of fermionic cloud increases with M, while the rotational 
symmetry of the annular density profile is kept as shown 
in Fig.Ete). 

In conclusion, we have studied the phase separation be- 
tween spin-polarized fermions and the BEC at high angu- 
lar frequency in the MF-LLL regime. The ground-state 
reconstruction has been found in the density profiles, an- 
gular momenta, and boson-fermion interaction energy. 
We have shown that this reconstruction associated with 
the phase separation can be understood in terms of suc- 
cessive penetration of the angular-momentum fluxes to 
the fermionic cloud. We acknowledge Akira Oguri for 
fruitful discussion and comments. 



[1] A.G. Tmscott et a/., Science 291, 2570 (2001); F. Schreck 

et al, Phys. Rev. Lett. 87, 080403 (2001). 
[2] B. DeMarco and D.S. Jin, Science 285, 1703 (1999). 
[3] E.A. Donley et al, Nature (London) 417, 529 (2002). 
[4] K.M. O'Hara et al, Science 298, 2179 (2002); C.A. Regal 

et al, Nature (London) 424, 47 (2003). 
[5] S. Inouye et al, Phys. Rev. Lett. 93, 183201 (2004). 
[6] M.J. Bijlsma, B.A. Heringa, and H.T.C. Stoof, Phys. 

Rev. A 61, 053601 (2000); J. Tempere et a/., Phys. Rev. 

B 72, 094506 (2005). 
[7] L. Mathey et a/., Phys. Rev. Lett. 93, 120404 (2004); 

M. Cramer, J. Eisert, and F. Illuminati, Phys. Rev. Lett. 

93, 190405 (2004); T. Miyakawa, H. Yabu, and T. Suzuki, 

Phys. Rev. A 70, 013612 (2004); M. Salerno, Phys. Rev. 

A 72, 063602 (2005). 
[8] C. Ospelkaus, et el., Phys. Rev. Lett. 96, 020401 (2006); 

T. Karpiuk et a/., Phys. Rev. Lett. 93, 100401 (2004). 
[9] A. Minguzzi and M.P. Tosi, Phys. Rev. A 63, 023609 

(2001) ; CP. Search et a/., Phys. Rev. A 65, 063615 

(2002) ; M. Cozzini and S. Stringari, Phys. Rev. Lett. 
91, 0704 01 (2003); G. Tonini and Y. Castin, e-print 
cond-mat/0504612 

[10] K.W. Madison et a/., Phys. Rev. Lett. 84, 806 (2000); 

J.R. Abo-Shaeer et a/.. Science 292, 476 (2001). 
[11] M.W. Zwierlein et a/.. Nature (London) 435, 1047 

(2005). 

[12] T.-L. Ho and C.V. Ciobanu, Phys. Rev. Lett. 85, 4648 
(2000). 

[13] M. Toreblad et a/., Phys. Rev. Lett. 93, 090407 (2004). 
[14] N.K. Wilkin and J.M.F. Gunn, Phys. Rev. Lett. 84, 6 
(2000). 

[15] A.H. MacDonald et al, Aust. J. Phys. 46, 345 (1993). 
[16] S.M. Reimann et a/., Phys. Rev. Lett. 83, 3270 (1999). 
[17] C. de C. Chamon and X.G. Wen, Phys. Rev. B. 49, 8227 
(1994). 

[18] U.R. Fischer and G. Baym, Phys. Rev. Lett. 90, 140402 

(2003) ; T.-L. Ho, Phys. Rev. Lett. 87, 060403 (2001); 
G. Baym and C.J. Pethick, Phys. Rev. A 69, 043619 

(2004) . 

[19] For free bosons and free fermions of A^b = Nf = N, 
the angular-momentum states are mapped as Lf = i^s + 
N(N — l)/2 each other. For weakly-interacting system, 
the MF-LLL regime for bosons corresponds to 0{Nb) ^ 
Lb < 0{Ni). This regime is mapped for fermions as 
0{N^) < Lf < 0(Ar|), which is roughly expected to be 
a MF-LLL regime for fermions. 

[20] D.A. Butts and D.S. Rokhsar, Nature (London) 397, 327 
(1999); G.M. Kavoulakis, B. Mottelson, and C.J. Pethick, 
Phys. Rev. A 62, 063605 (2000). 

[21] T. Karpiuk, M. Brewczyk, and K. Rzazewski, Phys. Rev. 
A 69, 043603 (2004). 

[22] D.A. Butts and D.S. Rokhsar, Phys. Rev. A 55, 4346 
(1997). 

[23] This is derived with the assumption /i = 0. We have 
confirmed numerically that the boson-fermion interaction 
hardly affects Qc?'* while the boson-boson interaction is 
crucial. 

[24] A.L. Fetter, Phys. Rev. A 64, 063608 (2001); E. Lundh, 
Phys. Rev. A 65, 043604 (2002); K. Kasamatsu, 
M. Tsubota, and M. Ueda, Phys. Rev. A 66, 053606 
(2002); V. Bretin et a/., Phys. Rev. Lett. 92, 050403 



(2004). 

[25] A.H. MacDonald, e-print |cond-mat/9410047| 



